- Working with solution design to provide technical input in ingestion, transformation, storage, and reporting. You will be part of a team driving toward the successful delivery of features that scales and handle the business’s growing demands.
- Participating in agile scrum ceremonies such as sprint planning, backlog grooming, estimation, and review.
- Design and automate data pipelines that meet business requirements, and other requirements such as security and architecture guidelines.
- Ensuring upcoming features have appropriate implementation designs allowing the teams to commit to delivery
- Work across teams to define efficient solutions and implementation strategies to create cohesive solutions across data products
- Forming a strong and trusted relationship with the Product Owner
- Ensure technical debt is managed in line with Telstra’s best practices
- Participate in proofs-of-concept and effectively transition and scale those concepts into production at scale through, engineering and deployment
- Drive agile thinking and ways of working to maximize collaboration and value creation
- Educating and assisting both team and chapter members with their software & data skills and providing technical documentation to assist others
- 3+ years of experience in relevant software development is essential
- Proficiency in programming with Spark (Python)
- REST API Development experience
- Experience with programming Python and using various libraries
- Experience in Shell Scripting
- Strong SQL skills
- Skills in data modeling with Bigdata and cloud, relational (RDBMS), and/or NoSQL database
- Experience in a cloud environment
- Experience with designing solutions for data acquisition, ingestion, integration, transformation, and persistence within Cloudera
- Ability to decide on the needed hardware and software design needs and act according to the decisions as well as develop prototypes and proof of concepts for the selected solutions
- Working knowledge of Kubernetes
- Knowledge of Kafka, Nifi, Netapp (S3), HDFS, and Yarn
- Knowledge of CICD and DevOps and tools such as GIT, Bitbucket, Bamboo, Jenkins, and Azure Devops
- Have a bachelor or master’s in Information Technology or similar
- Tertiary studies in Business Administration
Company
Location
Sidney - Australia
Job type
Full-Time
Python Job Details
Employment Type
Permanent
Closing Date
24 Oct 2022 11:59pm
Job Title
Junior Data Engineer
Job Summary
As a Data Engineering Analyst, you create and provide access to high quality and reliable data solutions. In collaboration with your colleagues you deliver and develop best practice data solutions and pipelines. You are known for the integrity and accuracy of data that enables quality data-driven business decisions and equip Telstra to deliver better customer and business outcomes. In a DevOps model, you will develop the data pipelines using Continuous Integration; Continuous Deployment (CICD) techniques.
Job Description
Make a difference
As part of Networks & IT, your mission will be to manage our world-class network covering the Australia population and connecting businesses globally. Work with leading tech and change the way we do IT to meet our critical business needs.
Role purpose summary
As a Data Engineer, you’re responsible for ingesting and transforming data into data platforms, so that inform data-driven decisions can be made to improve business outcomes and gain a competitive advantage. You will play a key role in building Telstra’s data capability with high-quality, reliable, and readily available data.
What you'll do
What you need to succeed
To be successful in the role, you'll bring skills and experience in:
Must Have
Highly Desirable
If this opportunity sounds like a perfect fit for you, we'd encourage you to apply!
More Developer Job Boards
Fullstack Developer Jobs Golang Jobs JavaScript Jobs Python Jobs React Jobs Rust Jobs Java Jobs